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A Message from the Presi- 
dent of the Treasury Board 


The manager in the Public Service is 
confronted by the continuous challenge: how 
to meet the needs of the public effectively 
and efficiently — particularly in the face of 
severe restrictions on resources. The intelli- 
gent application of the principles and 
techniques of good management is thus 
more important than ever. This need not 
involve complex administrative systems or 
the extensive use of electronic equipment. 
The relatively simple determination of how 
the performance of an organization varies 
over time can provide the base from which 
significant performance improvements can 
be realized. 


This booklet presents a brief exposition of 
the concepts upon which performance mea- 
surement is based and illustrates, using 
examples drawn from actual departmental 
experiences, how the concepts can be 
applied. The examples show how savings 
have been achieved in the cost of providing 
essential government services. 


A basic responsibility of Public Service 
managers is to ensure that the results for 
which they are responsible are being 
achieved as effectively and efficiently as 
possible. Application of the concepts de- 
scribed in this booklet will help to ensure that 
the means exist to assist managers in 
measuring the extent to which they are 
meeting this responsibility. 


Robert Andras 


1 Introduction 


_ Torun their organizations successfully, 
managers must have available certain key 
items of information about their operations. 
This applies to all levels of management and 
to all kinds of organizations, in both the 
private and public sectors. Such information 
is particularly important in meeting their 
responsibilities for planning, executing and 
controlling the work done by their organiza- 
tions. 


Public Service managers, to whom this 
booklet is addressed, will want information to 
allow them to answer such questions as: 


e How did the amount of work performed by 
their organization, in the period (year, quar- 
ter, month) just passed, compare to the 
amount done in the preceding period? What 
caused the change, if any? 


e What specific goods and services did the 
organization produce? What was the aver- 
age cost per unit of output produced during 
the period just completed? How did this 
compare to preceding periods? 


e How did the quality of the goods and 
services produced vary over these same 
time periods? Are the clients of the organiza- 
tion (the public, other departments or other 
parts of the same department) satisfied with 
the goods and services provided? How is 
this determined? 


e Ifthe volume of work to be performed by 
the organization changed by a given percen- 
tage, how many more (or fewer) resources 
would be required to do the work? 


. Could resources be used more efficiently 
if the level of service to clients were 
reduced? How much would the organiza- 
tion’s efficiency change for a given change in 
the level of service? 


e What percentage improvement (if any) in 
the efficiency of the organization, relative to 
the present levels, is being planned for the 
next period? How will the actual achieve- 
ment be measured? 


e Towhat extent is the work of the 
organization contributing to the achievement 
of the program, of which it forms a part? 


While not all of these questions are relevant 
to all parts of the public service, some of 
them certainly are. The readers of this 
booklet should be able to satisfy themselves 
about their ability to answer these questions. 
And they should give consideration to the 
improvements that might be obtainable, if 
they were able to answer more of them. 


This booklet describes the concepts of 
performance measurement. It shows how 
those concepts can be applied to departmen- 
tal operations, so that managers may be 
better equipped to answer the questions 
they are faced with in their day-to-day 
operations. In this way, managers can 
improve the manner in which they plan and 
control their operations. 


In a publication of this size, it is not possible 
to treat the subject in any great depth. A 
more detailed presentation appears in an 
earlier Treasury Board publication, Opera- 
tional Performance Measurement , Vols. 1 
and 2. Additional information on Treasury 
Board policy will be found in the Treasury 
Board Policy Statement, Circular 1976-25. 
Other references have been provided in 
Appendix B. 


The Concepts Underlying Performance Measurement 


2.1 Why Measure Performance? 


Before trying to define more exactly 
what performance is, and how it can be 
measured, it might be useful to determine 
why managers need to measure the perfor- 
mance of their organizations. 


The performance of an organization is 
measured because the knowledge thus 
derived provides essential information for 
planning and controlling the operations of 
the organization. Without a knowledge of 
his organization's performance, a manager 
cannot accurately relate the staff and other 
resources required to meet given volumes of 
workload. When resources are limited, the 
manager who knows the performance 
capabilities of an organization has the 
information needed to decide how far per- 
formance must be improved to cope with an 
increase in workload. For example, if it is 
clear that a higher level of service is being 
provided than is, in fact, called for, this can 
be decreased to achieve an increase in 
efficiency. If new procedures are introduced 
to improve performance, the actual increase 
can be determined only by knowing what the 
performance was before and after the 
change. If performance is regularly moni- 
tored, significant deviations from plan can 
usually be detected in time to take corrective 
action. Finally, performance measurement 
provides an essential quantitative base for 
any management-by-objectives program. 


It is important to understand that perfor- 
mance measurement is not a theoretical 
exercise, undertaken for its own sake. It is a 
practical, down-to-earth process for plan- 
ning, evaluating, controlling and, most impor- 
tantly, for improving the means by which 
government organizations produce and de- 
liver their goods and services. 


2.2 What Does Performance Mean 
in the Public Service? 


The performance of an organization in 
the Public Service context may be defined 
as: 

the extent to which its work is carried 

out within established specifications for 

the good or service produced, to the 
general satisfaction of the clientele 
served, within given cost and time 
constraints, and in such amanner as to 
support or contribute to the achieve- 
ment of the organization's objectives. 


Note that the definition demands, first, the 
identification of the output: exactly what 
good or service the organization is required 
to produce. It then demands the specification 
of the quality of that output, and the manner 
in which it is delivered to the client; the cost 
constraint in terms of the efficiency of 
production, which is the relationship be- 
tween what is produced and the cost of. 
producing it; and finally the effectiveness! of 
the operation: what contribution the output 
makes to the achievement of the organiza- 
tion’s objectives.’ 


To clarify the ideas contained in the defini- 
tion, some practical illustrations may be 
helpful. The outputs produced by govern- 
ment organizations are many and varied. 
Some, like Family Allowance and Un- 
employment Insurance cheques, postage 
stamps and superannuation payments, are 
tangible items and are delivered directly to 
the public. Others, like goods and materials 
from Supply and Services and office ac- 
commodation from Public Works, are tangi- 
ble but are delivered not to the public but to 
other departments. 


Some government services to the public are 
less tangible, like medical treatment, job 
placement interviews, manpower training 


1 Effectiveness is used throughout to mean the extent to 
which objectives, appropriate to the particular part of the 
organization being evaluated, are achieved. 


2 For definitions of other terms used in this paragraph 
and in others which follow, please refer to the Glossary, 
Appendix A. ' 


and advisory services for veterans or the 
unemployed. These services can, however, 
be quantified to some extent like the more 
tangible goods mentioned in the preceding 
paragraph. If the costs of providing these 
goods and services are known, then the unit 
cost of each can be calculated. By compar- 
ing the change in unit costs, the relative 
efficiency of the producing organizations can 
be measured. 


Some special services, such as scientific 
research or management consulting, are 
countable in terms of the number of projects 
undertaken; but the notion of using the 
variation of unit costs (per project) to indicate 
performance is meaningless, because of the 
great variations in cost from one project to 
another. 


Adherence to specification, whether a good 
or service, is a measure of the quality of the 
output. For a cheque, it is the correctness of 
the amount and the correctness of the name 
and address of the recipient. For mainte- 
nance work it is the extent to which 
standards are met. 


The manner in which the good or service is 
delivered to the client is a measure of the 
level of service. This is expressed in terms of 
timeliness and convenience: it is better 
service (more timely) to provide a Family 
Allowance cheque within four weeks of 
application, than within six weeks; on the 
other hand, it is poorer service (less conve- 
nient) if the Family Allowance recipient must 
obtain the cheque personally from a gov- 
ernment office, rather than receiving the 
cheque by mail (as is, in fact, the case). 


It has been stated earlier that some special 
services (research, consulting, etc.) do not 
lend themselves to measurement in terms of 
efficiency. They do, however, lend them- 
selves to measurement in terms of service 
(quality and level) and, at times, effective- 
ness. For example, a consulting group which 
responds promptly to its client’s request 
provides a better level of service than one 
which does not. 

Effectiveness cannot always be quantified 
so that results can be expressed numeri- 


cally, as in the case of efficiency. Further- 
more, it usually becomes more difficult to 
determine the effectiveness of an organiza- 
tion the higher one moves up in the program 
activity structure. A first-line supervisor may 
have as a goal the production of a certain 
number of output units at a specified 
efficiency, quality and level of service. 
Assuming his organization’s output is quanti- 
fiable and its inputs are known, the efficiency 
for a given time period can be calculated and 
compared to the target. Similarly the quality 
of the organization’s output can be deter- 
mined, as well as the manner in which it 
delivers the output (level of service), and 
these can be compared to their targets. The 
extent to which he achieves his goal (his 
organization's effectiveness), expressed in 
terms of efficiency and service, can thus be 
determined. 


On the other hand, the effectiveness of an 
activity in improving the health of Canadians 
by providing, for example, better hospital 
services, is much more difficult, if not 
impossible, to determine. This is so because 
the health of Canadians (assuming health 
can be defined satisfactorily) is influenced by 
many factors, outside the control of the 
hospital services activity (e.g. food, envi- 
ronment, individual fitness, exposure to 
disease, etc.). 


Effectiveness indicators must, therefore, be 
carefully considered in the context of the 
stated goals or objectives for the organiza- 
tion which is being evaluated. Their rele- 
vance as indicators will vary in accordance 
with the extent to which they reflect the 
contribution of the efforts of the organization, 
and the organization alone, to the achieve- 
ment of the goals or objectives. 


Effectiveness is obviously the principal con- 
cern of the manager: doing the wrong thing 
efficiently, or with good quality and level of 
service, is of no value in helping to achieve 
an organization’s objectives. 


The knowledge of overall costs by responsi- 
bility centres is certainly essential to sound 
financial management, but it is not enough 
for the measurement of performance. It is 


the knowledge of the relationship of cost to 
output, and how it varies over time, as well 
as the knowledge of how all the performance 
indicators interact, that provide the manager 
with the information he needs to control and 
improve the performance of his operations. 


An example from a departmental operation 
will help to bring these ideas into sharper 
focus. Consider the Excise Tax Audit func- 
tion of Revenue Canada, Customs & Excise. 
The role, principal activities and perfor- 
mance indicators of this function are shown 
in outline form in Example 1. In this 
operation, outputs are readily identified and 
counted, and the efficiency and service 


indicators are specific. In this example, an 
effectiveness indicator is also explicit. 


Another example is that of Public Archives. 
The tabulation of its principal outputs and 
performance indicators is shown in Example : 
2. This program also has an explicit effec- 
tiveness indicator. 


It should be emphasized that the activities 
and indicators given in these two examples 
are not meant to be complete; they are only 
the principal items, those considered to be 
the most useful in clarifying the concepts 
under discussion. 


Example 1 
REVENUE CANADA, CUSTOMS AND EXCISE 
EXCISE TAX AUDIT 


Principal Activities 


e periodic audit of about 65,000 manufacturers’ and wholesalers’ records to verify 
accuracy of reported tax liability (about 30,000 audits conducted annually) 


|. verification of refund claims (about 85,000 claims processed annually) 


The operating budget for 1976/77 is $14 million, with 740 man-years, decentralized into 


11 regions. 


Performance Indicators 


Efficiency 


. number of audits performed and refund claims processed per man-year 


Service (Quality and Level) 


e percentage of licensees contacted and informed of their tax obligations 


Effectiveness 
|. tax change per audit” 


* This term is defined in the departmental example in Section 3.3. 


Example 2 
PUBLIC ARCHIVES PROGRAM 


Principal Activities 


acquiring, organizing and preserving historical documents 
storing and maintaining records 


providing advisory services on records management 


providing technical and advisory services on micrographics 


| The program is largely centralized in Ottawa, with an operating budget (1976/77) of $13.8 
million and 653 man-years. However, some 66 man-years are located in six regional 
record centres across Canada. 


Performance Indicators 

Efficiency 

| e number of cubic feet of records disposed of per man-day 

e number of cubic feet of document records acquired and stored per man-day 
. number of accessions processed per man-day 

Service (Quality and Level) 

e backlogs of items above 

e average response time to requests for action 

Effectiveness 


¢ proportion of records successfully acquired out of total material identified for 
acquisition 


2.3 How is Performance 
Measured? 


The process for measuring the perfor- 
mance of an organization, in terms of 
efficiency, service (quality and level) and 
effectiveness, is straightforward and sys- 
tematic. The principal steps are to: 


(a) determine what outputs are pro- 
duced 


(b) determine the number of each kind 
of output produced in a given period 


(c) associate with, or allocate to, each 
output the cost of producing it during the 
same period 


(d) calculate the efficiency ratio for 
each output, i.e. 


no. of output items produced 
cost of producing them 


or calculate the unit cost by inverting the 
above ratio 


(e) calculate efficiency ratios for sev- 
eral periods and determine how they have 
varied; these can be expressed as index 
numbers relative to the base period and 
shown in a time series 


(f) identify the appropriate service indi- 
cators for each output and determine how 
these have varied over time and, if possible, 
the relationships between service and effi- 
ciency. 


(g) determine how the outputs contri- 
bute to the achievement of the organization’s 
objectives and identify effectiveness 
indicators, when appropriate 


(h) develop a simple means of reliably 
reporting performance information (together 
with the relevant financial data) to the 
responsible managers in a regular, timely 
manner. 


In some instances, this process may become 
complicated; the discussion of such compli- 
cations is beyond the scope of this booklet. A 
more detailed presentation of the subject is 


available in Operational Performance Mea- 
surement . 


The Application of Performance Measurement to 
Departmental Operations 


3.1 Treasury Board Policy on Per- 
formance Measurement 


In 1969, as an outgrowth of its work on 
Planning, Programming and Budgeting, staff 
of the Treasury Board Secretariat started to 
work with a few departments and agencies to 
develop and install systems for measuring 
performance. In 1973, the Ministers of the 
Treasury Board approved the concept and 
directed that all departments and agencies 
establish systematic ways of regularly 
measuring the on-going performance of their 
operations, to the extent feasible. Treasury 
Board Secretariat staff have continued to 
assist departments in meeting the Ministers’ 
goal of having Program Forecast submis- 
sions supported by performance data, be- 
ginning no later than the 1977/78 Program 
Forecast. 


In early 1976, the Ministers of the Treasury 
Board reviewed the progress being made 
and directed that the work be accelerated. In 
July, 1976, the program was formalized 
through the issuance of Treasury Board 
Policy Circular No. 1976-25. The Policy 
section of the Circular is reproduced below: 


Il Policy 


GENERAL STATEMENT 

1. Departments and agencies of the federal 
government whose programs are subject to 
Treasury Board review will, wherever feasi- 
ble, regularly measure the on-going perfor- 
mance of their operations in terms of the 
effectiveness with which their objectives are 
being achieved and the efficiency with which 
they are being administered. 


TIMING 

2. As directed by Treasury Board Ministers 
in April 1973, departments and agencies 
were to begin to provide performance mea- 
surements, where appropriate, in support of 
their program requirements by no later than 
the 1977/78 Program Forecast. 


3. Departments and agencies will continue 
to improve their ability to measure routinely 
the performance of their operations, for both 


internal management and resource alloca- 
tion purposes, so that by 1980 all will be 
using adequate and reliable systems, 
wherever feasible, for performance mea- 
surement. Progress towards this goal will be 
reviewed periodically by Treasury Board 
Secretariat officers. 


The circular, which is commended for further 
reading, contains a considerable amount of 
reference information in its guidelines sec- 
tion and in the appendix. Copies are availa- 
ble in every department. 


3.2 Some Comments on the Ap- 
plication of Performance Mea- 
surement to Departmental Opera- 
tions 


A few comments may be useful to clarify 
the extent to which performance measure- 
ment can be applied and how it might be 
adapted to the specific operations involved. 


(a) The measures and indicators which are 
derived from the process already described 
are relative — to a reference or base year. 
They are not absolute measures in the sense 
of time standards derived from work mea- 
surement techniques. Such engineered time 
standards can be incorporated in the per- 
formance measurement process. However, 
the development of such standards is likely 
to be applicable in only certain specialized 
operations of a production nature. In using 
relative standards, managerial attention is 
focused on trends, or changes, in the 
measures and indicators, and on the 
answers to such questions as: is perfor- 
mance improving or worsening; have per- 
formance targets been met, etc.? 


(b) Performance measurement focuses on 
organizations, not on individuals. Other 
approaches must be taken to appraise the 
work of individual managers and their per- 
sonnel. 


(c) Efficiency measures may not be ap- 
propriate for certain line operations, where 
outputs are difficult to identify or where they 
vary greatly. This is the case in most 


project-oriented work, where the notion of 
projects/man-year (or its inverse, man-year 
cost/project) may have relatively little sig- 
nificance because projects vary so greatly in 
size, complexity and duration. 


To illustrate how service and effectiveness 
indicators can be significant when efficiency 
indicators are not appropriate, consider 
again the example of the consulting group 
referred to briefly in Section 2.2. From the 
client’s point of view, indicators of quality 
and level of service would include the time 
taken to respond to his request for assis- 
tance as well as the group’s success in 
completing the project within the time and 
cost limits originally agreed to. Effectiveness 
can be rated in terms of the extent to which 
the project’s objectives were met. For exam- 
ple, where savings were supposed to result 
from the installation of new procedures, the 
effectiveness of the group’s work would be 
indicated by the extent to which the actual 


savings compared to those initially proposed. 


Some overhead functions, such as 
financial and personnel administration, are 
also difficult to measure in terms of efficiency 
(except in the case of some large-scale, 
repetitive operations), although it should be 
possible to develop service and effective- 
ness indicators for them. Additionally, over- 
head functions can be controlled to some 
extent by expressing overhead costs as a 
percentage of total costs and monitoring the 
changes in the percentage over time. 


(d) The selection of a reference or base 
period is important, in that it should repre- 
sent as typical a period as possible from the 
operational point of view. It should be free 
from major re-organizations or large-scale 
changes in operating systems. 


If the base period selected turns out to have 
been a poor choice, another more suitable 
period can be selected and the data can be 
rebased. When many outputs and organiza- 
tional components are involved, this can be 
a tedious process and not one to be 
undertaken lightly. 


(e) lfan organization produces more than 
one output, these outputs may be combined 


by a process called aggregation. This in- 
volves assigning weights to each output and 
deriving the total weighted output, as de- 
scribed in Operational Performance Mea- 
surement . The efficiency of the production 
of the combined, or aggregated, outputs is 
determined by dividing the total weighted 
output by the total input costs. A similar 
process can be used to combine the outputs 
of more than one responsibility centre. 


Aggregation provides a means of coping with 
changes in the mixture of outputs from one 
time period to another. This is illustrated in 
the case of the District Maintenance Opera- 
tions of the National Capital Commission, 
Section 3.3, which follows. 


(f) When the work of an organization 
changes and outputs are added, it is 
necessary to incorporate the new outputs 
through rebasing or through the linking 
technique described in Volume 2 of Opera- 
tional Performance Measurement . Outputs 
may be deleted through a similar, but | 
simpler, application of the same technique. 


Valid linking is, of course, preferable from 
the performance viewpoint because it main- 
tains the continuity of the time series. 


(g) Itmay not be important, for manage- 
ment planning and control purposes, to 
gather and allocate costs to relevant outputs 
with absolute accuracy. Where salaries 
form the bulk of operational costs, sufficient 
accuracy may be obtained using only man- 
years (or salaries) and ignoring the many 
other less significant items of expense. In 
certain cases, where it is difficult to deter- 
mine exactly how costs should be divided 
among several outputs, it may be accurate 
enough to rely on managerial estimates. 


(h) The information provided by perfor- 
mance measurement systems is also of 
value in resource allocation, because it 
provides data on past and present levels of 
performance, as a guide to assessing future 
requirements. 


3.3 Examples of Departmental 


: Applications 
The following examples have been trolling. These have been included in this 
selected from a variety of government publication with the approval of the organiza- 
operations to illustrate the uses of perfor- tions concerned. 


mance measurement in planning and con- 


HEALTH & WELFARE CANADA 
income Maintenance Branch 


Principal Activities 


« administers the Family Allowance, Old Age Security, Guaranteed Income Supplement 
and Spouse Allowance programs which provide for transfer payments in excess of $6.5 
billion annually. 


Over 3.5 million Family Allowance accounts and 2.0 million Old Age Security accounts 
are administered by this branch with an operating budget of $31.6 million and 2,076 
man-years (1976/77). 


The organization is almost completely decentralized with a small head office in Ottawa 
and 95% of the staff located in ten regional and four district offices. 


Performance Indicators 


The branch performance measurement system has a standard structure with a maximum of 
eight measurable operations in the regional offices. 


EFFICIENCY 

Each measurable operation has an efficiency index and there are two main categories of 
operations: 

* processing — number of accounts administered per man-year 

. client services — units of service (client interview, telephone interview, field visit) 
performed per man-year. 


SERVICE (QUALITY & LEVEL) 

There are some 26 indicators, each of the eight measurable operations having its own set. 
Typical service indicators are: 

. average elapsed time to process applications for benefits 

¢ percentage of cheques returned 

. processing error rates 

. average waiting time for a client interview 

. average response time for a field visit 


10 


Efficiency and service measures have been established for approximately 85% of the 
operations. Performance is reported monthly through a manual data collection and analysis 
system which requires only two man-years per year to maintain. Both regional and head 
office management can review and react to performance results on a monthly basis. 


At the same time as branch management monitors movements in efficiency, it watches the 
level of service indicators. By so doing, management can achieve efficiency goals while 
maintaining an adequate level of service. 


Over the four-year period 1971/72 to 1975/76, workload increased 9.5% (chart 1), while 
man-years decreased 3.1% (chart 2). This resulted in an efficiency improvement of 12.8% 
(chart 3). Meanwhile, the level of service has been improved significantly. As an example, 
over the period 1973/74 to 1975/76, the average response time for processing new Family 
Allowance applications improved from 11.4 to 5.8 days. 


REGIONAL COMPARISONS 

Chart 4 shows the comparative productivity of the 10 regions for FY 1972/73. As a result of 
having this information, management was able to concentrate on improving the productivity 
of certain regions by exchanging innovative practices from similar regions with better 
performance. 


This, along with other innovations, resulted in the improvements described in the preceding 
section. 


FAMILY ALLOWANCE AND OLD AGE SECURITY 


REGIONAL OPERATIONS COMPARATIVE PRODUCTIVITY 1972/73 


As ec me | He 
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HEALTH AND WELFARE CANADA 
Canada Pension Plan Branch 


Principal Activity 


+ administration of the Canada Pension Plan legislation. It operates in all parts of Canada 
except in the province of Quebec which has its own comparable plan. Ona compulsory basis 
the Plan covers nearly everyone who is working. The operating budget in 1976/77 is about 
$13.2 million and 768 man-years. 


Performance Indicators 


EFFICIENCY 

Efficiency measures have been established for over 90% of the operations. The principal 
measures of efficiency are the number of the following types of benefit applications 
processed per man-year: 

e retirement pensions 


e lump sum death benefits 

e surviving spouse benefits 

e orphan’s benefit 

e disabled contributor benefits 

e benefits for the children of a disabled contributor 
SERVICE (QUALITY & LEVEL) 


The principal service indicators are: 
e the average time taken to process and put benefit applications into pay 


¢ error rates associated with the processing of applications 
e the inventory of work on hand at the end of each month. 


The Field Services Division, with over 400 man-years, is the largest division in the 
Branch. As expected, of the 40 or so District offices, the larger offices achieve the greatest 
economies, since their staffs can be more evenly loaded with work throughout the year. This 
is illustrated by chart 1, which is a plot of the relative unit cost per application processed 
against the corresponding volume of applications for each office. 


Three principal ways in which this information can be used to plan and control manpower 
resources are: 

e The offices located on the left hand (higher unit cost) portion of the curve can plan to 
accommodate an increase in workload by a less-than-proportionate increase in man-years 
due to an anticipated decline in the unit costs and a commensurate increase in efficiency. 


° Management of the Division can consider, when deciding where to locate new offices, 
the possibility of locating them in the proximity of those offices that are past the point of 
lowest unit cost. Workloads and staff can be appropriately split to reverse the trend of rising 
unit costs. 


e = The visibility provided of offices experiencing significantly higher or lower unit costs than 
the average depicted by the curve, allows management to identify both strong performers 
and potential problem areas. 


For the entire Canada Pension Plan Branch, initial results showed an increase in direct 
efficiency of 28.9% over a two-year period, 1973/74 to 1975/76 (see Chart 4). This was due 
to a 41.1% increase in output (Chart 2) accompanied by only a 9.5% increase in the man- 
years (Chart 3), associated with the measured operations. 
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NATIONAL CAPITAL COMMISSION 
District Maintenance Operations 


Principal Activity 


+ maintenance and management of 8,500 acres of park, parkways and government 


grounds in the National Capital Region. The operating budget in the fiscal year 1976/77 was 
$4.9 million and 283 man-years. 


Performance Indicators 


EFFICIENCY 
e the weighted number of maintained acres per man-hour and dollar 


e the weighted number of work units for each sub-activity, (e.g. number of trees, square 
yards of flower beds, etc.) per man-hour and dollar 


SERVICE (QUALITY & LEVEL) 
e extent to which standards are met 


e number of complaints 
Management Use of Performance Measurement 


The implementation of performance measurement in the District Maintenance Operations of 
the National Capital Commission provides management with a two-tier system for effective 
control. 


For senior management purposes this entails: 
1. The efficiency of maintenance activities in terms of the weighted number of maintained 
acres of land per man-year and dollar . 


2. Asetof quality standards for the overall maintenance of these acres to enable 
establishment of targets for achievement. 


3. An objective assessment of maintained land to provide a measure of the extent to which 
targeted standards are met. 


For middie management purposes this entails: 
1. The efficiency of maintenance for sub-activities in terms of the weighted number of work 
units for each sub-activity per man-year and dollar. 


2. Aset of quality standards for monitoring the performance of sub-activities and to enable 
establishment of targets for achievement. 


With this system, management was able to assess the results of trade-offs between 
efficiency and the quality of service. For example, in 1975/76, a decision was made to 
achieve a saving of 16 man-years from the estimated requirement. This resulted in a net 
decrease of 6% in the quality of maintenance, with no change in efficiency. ! 


1 The Commission has established five levels of quality for the maintenance operations; the acreage at each quality 
level is considered to be a separate output, with its own output weight. When, in the case above, an area of land was 
changed from one quality level to a lower level (a change in the output mix), the weighted output decreased. For this 
reason, while the total acreage increased durong 1975/76 (Chart 1), weighted output (Chart 2) decreased. This 
decrease matched the decrease in input (Chart 4), so that the efficiency index (Chart 5) remained constant. The quality 
index decreased as shown in Chart 3. 


15 


16 


In the subsequent fiscal year, 1976/77, the acreage of maintained land increased by 400 
acres but an additional savings of 11 man-years below the calculated requirement was 
decided on. Again, the net effect was a further decrease of 4% in the quality of service with 
no change in efficiency. The result has been an increase in the number of complaints 
received from client departments and the general public. 


In fiscal year 1977/78, the acreage of maintained land was expected to increase by 250 acres. 
It was decided, however, to maintain total acreage at the same quality standard of maintenance 
as in 1976/77 without additional man-years and, thus, achieve a 3% increase in efficiency 
(Chart 5). 
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REVENUE CANADA — CUSTOMS & EXCISE 
Excise Tax Audit 


e periodic audit of about 65,000 manufacturers’ and wholesalers’ records to verify accuracy 
of reported tax liability. About 30,000 audits conducted annually. 


e verification of refund claims. About 85,000 claims processed annually. 


The operating budget for 1976/77 is $14 million, with 740 man-years, decentralized into 
eleven regions. 


Performance Indicators 


EFFICIENCY 
e number of audits performed and refund claims processed per man-year 


SERVICE (QUALITY & LEVEL) 
e percentage of licensees contacted and informed of their tax obligations 


EFFECTIVENESS 
e tax change per audit* 


Management Use of Performance Measurement 


The measurement system was introduced in fiscal year 1971/72. Chart 1 shows that the 
output increased steadily until 1973/74 and then fell off. The input, Chart 2, which had been 
rising moderately up to 1973/74, climbed more rapidly. As a result, efficiency Chart 3, took a 
steep drop following 1973/74, after a very gradual decline in the period 1971/73 to 1973/74. — 


But the apparent drop in performance, as indicated by the declining efficiency, does not tell 
the whole story. As a result of having this performance information, the management of the 
Excise Branch was able to determine how to increase the effectiveness of the Excise Tax 
Audit. After undertaking a study to determine how best to achieve greater effectiveness, a 
new system of audit selection and procedures was adopted in 1973/74. The new approach 
used a cost recovery analysis as a basis for selection, rather than the strictly cyclical and 
global method of audit selection. Audits were concentrated on licensees with high revenue 
potential. Another change was the increased emphasis placed on the tax consulting role of 
providing information to licensees on their tax obligations and requirements. 


These changes produced a positive result on the audit effectiveness indicator — tax change 
— defined as the monetary effect of the audit upon tax paid. This is graphically illustrated in 
Chart 4, where the tax change per audit is seen to rise sharply after 1973/74. 


This is an example where the availability of performance information enabled management 
to make a trade-off between efficiency and effectiveness in favour of the latter, since a 
principal objective of the function was to maximize revenues due to the Crown. The Excise 
Branch will continue to refine the system to a point where a dollar of audit activity will 
generate a dollar of tax change (break-even point), thus maximizing effectiveness. 


* this term is defined in the text. 
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Appendix A 


Glossary of Terms 


Activities: 
Aggregation: 
Base Period: 


Effectiveness: 
Efficiency: 
Index Number: 
Input: 
Measurable 
Operation: 
Operation: 
Output: 
Output 
Weight: 


Overhead: 


Performance of 


an Organization: 


Program: 


Responsibility 
Centre: 


Alternative or complementary means of achieving an objective or 
set of objectives of a program. 


The combining of outputs or indexes through the application of 
appropriate weights. 


A period of time, e.g. a year, quarter or month, selected as a base 
for comparing the performance during other time periods. 


The extent to which an objective or goal is achieved. 
The ratio of output to related input. 


A number which expresses the relative magnitude of a variable 
over time or between locations. 


Resources, e.g. labour, capital and material, utilized in the 
production of output. 


An operation the output of which can be quantified. 


A work process occurring within a responsibility centre and 
producing a single type of output. 


Goods and services produced. 


A numerical factor used to combine different outputs on a common 
basis for aggregation purposes. Unit cost is frequently used for this 
purpose. 


All operational expenditures other than those identifiable with 
specific operational outputs. 


The extent to which its work is carried out within established speci- 
fications for the good or service produced, to the general 
satisfaction of the clientele served, within given cost and time 
constraints, and in such a manner as to support or contribute to the 
achievement of the organization’s objectives. 


A group of related departmental activities designed to achieve 
specific objectives authorized by Parliament (see Activities). 


An organizational unit in which the manager has been delegated 
authority to manage financial resources, including responsibility for 
determining financial requirements, controlling costs in relation to 
operational accomplishment, and exercising spending authority to 
approve charges against his budget. 
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Service: 


Unit Cost: 


Weighted 
Output Value: 


The combination of quality (conformity of the output to specifica- 
tions) and level (the manner in which the output is delivered). 


The cost of producing a unit of output which can be expressed, for 
example, as X man-hours per unit or Y $ per unit. 


The total output derived by combining different outputs through the | 
application of base period output weights. 


Appendix B 
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